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Title 

Autofocusing method for telescopes of surveying instruments. 
Field of the invention 

The invention relates to an autofocusing method, particularly for telescopes of surveying 
instruments, and it is suitable for image sensors that resolve the image signal into individual 
image elements (pixels), such as CCD lines and matrices as well as CMOS image sensors. 

State of the art 

Autofocusing systems for surveying instruments are already known. German Preliminary 
Published Application DE-OS 196 14 235 describes an autofocus for a level. Here, an 
additional optical system located behind the focal plane serves to detect the sharp setting by 
means of two imaging lenses that generate object images on two line sensors. Moreover, 
means to detect the focusing lens position are necessary. 

German Preliminary Published Application DE-OS 195 49 048 should be seen in this con- 
text; by means of a beam splitter, a plane is generated that is equivalent to the focal plane 
for the focus detection system. This approach has the disadvantage that it cannot be easily 
transferred to a digital level. 

German patent no. 34 24 806 as well as the publication titled "Zeitschrift fiir Vermcs- 
sungswesen und Raumordnung" [Journal of surveying technology and area planning], April 
1995, pages 65 to IS, disclose the use of beam splitters in order to generate a second focal 
plane for the CCD line needed for the evaluation. An additional autofocus optical system 
would then require a third equivalent focal plane if the telescope should continue to be used 
for visual observations. 



European patent EP 576,004 discloses a digital level with an autofocus in which focusing 
takes place at a maximum amplitude - measured or else calculated by means of linear 
interpolation - of the Fourier transforms of the detector signal in a coarse and fine incre- 
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rnent raster. This approach is likewise problematic. Depending on the focusing distance, the 
Fourier transformation of a survey image can lead to differing results if, as is necessary for 
digital leveling, the scanning theorem cannot be observed for all of the leveling rod mark- 
ings that arc present along the entire range of the focusing distance. 

Japanese Preliminary Published Application JP-OS 4-93 711 comprises an autofocus for a 
CCD camera that is connected via a tachymeter telescope to a beam splitter. A focusing 
lens is adjusted by a motor in such a way that the image size of the imaged object is mini- 
mal. This approach likewise does not necessarily ensure optimal image sharpness since the 
minimum can be relatively wide and therefore hard to detect. 

U.S. patent no. 5.481,329 describes an autofocusing device with an additional imaging after 
the focal plane on four sensors and with a correlation of the images formed on the opposite 
side. The sum of differences between adjacent pixels is taken as the contrast value. 
Depending on the outcome, additional filters arc available for other spatial frequencies. 
Depending on whether an object generates a high-contrast or a low-contrast image, the DC 
component is removed completely or partially. The disadvantageous and complex aspect of 
this arrangement is the additional optical system that is needed. 

U.S. patent no. 5,715,483 discloses the technique of first carrying out measurements in 
large increments over the entire focusing range whereby the maximum of the output signal 
of a broad-band filter is employed as the criterion. Then, in a second step, smaller incre- 
ments are used to search within a smaller range around the value of the maximum using a 
high-pass filter as the criterion. This is done in order to prevent secondary maxima of a 
function that is relevant for the autofocus from giving rise to an incorrect adjustment of the 
focus. This approach likewise entails drawbacks. For instance, it is first necessary to focus 
over the entire range in order to find a maximum through the use of a broad-band filter. If 
no maximum can be found in this manner, a low-pass filter has to be used instead of a high- 
pass filter in the second step. The entire procedure is impractical and complex. 
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It is common knowledge that the image contrast is at a maximum when the focusing is 
optimal. German patent DE 195 00 817 also discloses the technique of using edges as 
objects of the greatest contrast in the image as a local maximum or minimum of the cross 
correlation function (CCF) of some pixels of the image content with an ideal edge. 

Description of the invention 

The objective of the present invention is to eliminate the disadvantages of the state of the 
art to the greatest extent possible so as to obtain an autofocusing control signal and to 
determine the point (state) of optimal focusing of the telescope without using additional 
optical means and without having to necessarily pass through the entire focusing range. 

According to the invention, this objective is achieved with the means indicated in the first 
patent claim. The subordinate claims present details and embodiments of the invention, 

For example, in the case of two-dimensional image detectors, it is advantageous to perform 
the calculations in the direction of the rows, in the direction of the columns or else in both 
directions at the same time. 



It is likewise advantageous if the focusing path until the next measurement is ascertained as 
the product resulting from the ratio of the maximum signal to the local signal amplitude, 
from the focus position relative to the position during focusing towards the infinite and 
from a constant. 

Moreover, it can be an advantage to provide an ideal edge as the comparison structure for 
the cross correlation function. It is likewise advantageous if the reference function is the 
maximum of the cross correlation function* 

Brief description of the drawings 

The invention will be elaborated upon below with reference to an embodiment example. 
The following is shown: 
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the signal depiction of a CCD line in a completely defocused image; 
the signal depiction of a CCD line in a defocused image but with the image 
content already recognizable; 

the signal depiction of a CCD line in a focused image; 

a flowchart for the first part of the autofocus algorithm described in the exam- 
ple, and 

a flowchart for the second part of the autofocus algorithm described in the 
example. 

Comprehensive description of the drawings 

Figure 1 shows the survey image of the CCD line of a digital level with complete defocus- 
ing. The x axis 1 consecutively shows the pixel numbers i from 0 to 1799. The brightness 
of each pixel Y { is plotted in random units on the y axis 2. The value 255 means no signal 
(black) and the value 0 means maximum signal (white), thus resulting in a negative depic- 
tion. Therefore, the actual measurement curve 3 shows the brightness as a function of the 
pixel number Y| = f (i). 

Due to the defocusing, only two essential features can be seen in Figure I. The function 
vulues at the line beginning 4 and at the line end 6 arc rated here approximately as the dark 
signal Y D (r,- or Y I799 = Y D ). 

The survey images as shown in Figures 1 through 3 were taken with a digital level whose 
design only permits a small amount of light to reach the beginning or the end of the CCD 
line. Naturally, in principle, the dark signal can also be determined on the basis of a sepa- 
rate measurement. The second essential feature is the brightest point 5 in Figure 1, Y 7 2o = 

Ymin- 

In this example, the brightest point occurs at pixel 720. The signal Y mln is used for exposure 
control in a familiar manner. Y min has to be kept within certain limits. Thus, for instance, it 
cannot become zero since then the CCD line is overexposed. 



Figure 1 - 
Figure 2 - 

Figure 3 - 
Figure 4 - 

Figure 5 - 
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The first essential value for the focusing that can be obtained from the survey image is the 
maximum signal Sjt 



It can be derived from Figure 1 that Y D = 210 and Y min = 100. As a result, Sj is J JO. 
The acquisition of the second value on the basis of the survey image is then explained with 
reference to Figure 2, which shows a signal depiction of a CCD line in a defocused image. 
A certain image content is already recognizable here. The pixel 10 on the curve that is 
located closest to the optical axis is the pixel i - 900. It will be referred to below as the 
middle pixel (MPX). On the basis of MPX, the local signal amplitude S 2 is calculated from 
the monotonically decreasing or increasing signal all the way to the next local maximum 
Yj mflx and minimum Y| min . For this purpose, starting with i = MPX, i is reduced until either a 
local maximum or a local minimum is reached so that the following prescriptions or rules 
are provided: 

i starting at i = MPX decreasing in -1 increments, maximum N increments, (2) 

as long as Yi < Y,+i. the last i results in Y| min 

or 

i starting at i = MPX decreasing in —1 increments, maximum N increments, (3) 
as long as Y| > Yi+i, the last i results in Yj m .a X . 

Subsequently, i is increased starting from MPX, so that 

i starting at i = MPX increasing in +1 increments, maximum N increments, (4) 
as long as Y {+1 > Y 4 , the last i results in Y imax 



S, = Y D -Y, 



min 



(1) 



or 



i starting at i = MPX increasing in +1 increments, maximum N increments, 
until Yi+i < Yi, the last i results in Y, min . 



(5) 
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whcreby for rules (4) or (5), only the appertaining inverse smaller or greater sign was 
evaluated, as realized in rule (2) or (3). 

The number N over which the rules (2) through (5) can pass at the maximum results from 
half the structure width of the object to be focused at the shortest focusing distance. In this 
example, it is assumed that N= 180. This value results from the structure widths of the 
imaged digital level measuring rod. 

If, however, rules (2) through (5) result in a maximum or a minimum in both directions, 
then Ympx = Vimin or Ympx = Yi max . 

In a further refinement of rules (2) through (5). in order to suppress noise, another ampli- 
tude of approximately ±3 amplitude increments that differs locally from the monotonic 
sequence is permissible. 

Then, the local signal amplitude results in the following: 

S2 - Yimox - Yimin (6) 

In Figure 2, it is assumed that a pixel 12 is the one with the local maximum (lmax) at i ~ 
800 and a pixel 1 1 is the one with the local minimum (lmin) at i = 950. The following holds 
true: 

Y| IWU = Y 800 = 140 

Yj mt n = Yosd = 80 

Thus, the result is S2 = Ygoo - Y950 - 60. 

The first relationship (formula) for focusing is as follows: 

Focusing path = (S1/S2) • focus position ■ constant 

(7) 
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In this context, the following rules or determinations apply: 
Sj/S2 is limited to a maximum value, for example, 4 in Figure 4. 

Focus position normalized on the focusing path = 1; infinite has the lowest value (= 0). 

In Figure 1, Sj = 110, S 2 = 20. Thus, $i/S 2 = 5.5. If, for example, 0.05 is selected as the 
constant, at a focus position close to 1 (shortest focusing distance), these values allow a 
focusing path of 0.28 to be passed with the next increment. 

In Figure 2, Si = 150, S 2 = 60 and Si/S 2 = 2.5. With the constant of 0.05 at a focus position 
close to 1 (shortest focusing distance), the result is a focusing path of 0.12 that can be 
passed with the next increment. 



With a focusing position close to 0 (infinite), in spite of extreme defocusing, there is only a 
small possible value for the focusing path. In this context, it has been found that, by means 
of the criterion S,/S 2 , it can be decided as a function of the focusing distance whether a lar- 
ger or a smaller focusing path can be traversed until the next measurement without passing 
the focus in the process. The appertaining flowchart is shown in Figure 4. 

The fact that it is not the signal amplitude but rather the ratio S,/S 2 that goes into rule (7) 
has the advantage that rule (7) is independent of the amplitude. As a consequence, it can 
already be employed before an optimal exposure regulation has been made. Thus, the cal- 
culations and changes in the focus position of the members for the autofocus can already 
take place during the exposure regulation. 

The method needed for the subsequent fine focusing as well as another calculation value 
used here are explained with reference to Figure 3 which, in turn, shows the same object as 
in Figures 1 and 2, but in the focused state. The measurement curve 20 contains dark areas 
21 and bright areas 22 which are separated by edges 23. The edges only encompass a few 
pixels of the image. The pixels 24. 25, 26 and 27 of edge 23 are drawn in Figure 3. 
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The pixels 24 through 27 in this sequence have the following signals: 
24: Y g< so = 1 89; 25: Y 86 i = 170; 26: Y 862 = 135; and 27: Y gfi3 =115. 

The third function, which is essential for the focusing procedure, is the cross correlation 
function (CCF) consisting of four pixels and an ideal dark-bright edge having the signals 
(+t;+l;-l;-l). 

It is formed according to the following equation: 

CCF(i) = Yi + Y M - Y i+2 - Y i+3 (8) 

In the example of edge 23, this results in CCF(860) = 109. The CCF is formed pixel-wise in 
the manner known from German patent DE 195 00 817. At places of a local maximum of 
this function, edges which lie in the range of pixels Y l+ , and Y i+2 appear in the survey 
image. The precise position is subsequently ascertained through interpolation. 

For the focusing procedure, it is essential for the CCF to be a measure of the image con- 
trast. On the basis of the CCF maxima, a reference function can be formed that can provide 
information about the focusing state. It is advantageous and simplest to use the maximum 
value of the CCF as the reference function in the entire image field. With somewhat more 
effort, the mean value from the local maxima of the CCF could likewise be used as the ref- 
erence function. Hereinafter, the reference function thus formed will be designated as 
CCF MAX . 

The further course of the focusing procedure consists of maximizing the function 
CCFmax/S 2 . It is practical, depending on the magnitude of the CCF MA x/S 2 function, to 
adjust the focusing path either to the douhle depth of fieid, as long as CCF MAX /S 2 is < 0.5. 
If the value 0.5 is exceeded, the focusing path is then limited to the depth of field until the 
next measurement. The course of the focusing procedure is shown in Figure 5 in the form 
of a flowchart. 
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In this context, the focusing path can be measured or else it can be set with sufficient preci- 
sion without measurement by means of suitable regulation of the focusing motor, for exam- 
ple, a stepper motor. 

In order to find the maximum of CCF M ax/S2, after it has been passed one time, it is nor- 
mally sufficient to cany out three measurements in the vicinity of the maximum. In the 
simplest case, the maximum is the largest value of the CCFmax/Sj of these three measure- 
ments. With somewhat more effort, the position of the maximum, also with a higher reso- 
lution, can be calculated on the basis of the three measured values, for instance, by means 
of parabolic interpolation. Such methods are common knowledge and therefore need not be 
elaborated upon here. 

The rules that apply to the focusing arc compiled in Figures 4 and 5. Figure 4 shows that 
rule (7) is used either until the focus position is < 0.1 or until S|/Sa falls below the value 
I .4. 

Figure 5 shows that if one of the above-mentioned conditions is met, CCF MAX /S 2 is formed. 
The increment range is limited to the depth of field as soon as CCF M ax/S 2 > 0.5. This is 
then followed by traveling up to the maximum CCFmax/S^. 

The invention is not limited to the example given above. The constants selected for the 
decisions can assume other values that have been optimally adapted to the optical system in 
question. The increment ranges indicated in Figure 5 for the focusing can also assume other 
values, such as the entire or half of the depth of field. Instead of CCF, another markedly 
contrast-dependent function can be likewise employed. Tt is also possible to use the func- 
tion CCFmax instead of CCF M ax/S 2 as the criterion for the decision, except that then it must 
be ensured that the exposure no longer changes during the focusing procedure. 



